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A COMPARISON OF IDIOSYNCRATIC STUDY, PASSIVE READING AND INSERTED 
QUESTION TREATMENTS IN LEARNING FROM TEICT 



Jack H. Hlller Harry Dentel 

Soiittnrest Regional Laboratory Southern Illinois University 

California Carbondale 

ABSTRACT 

Lloited evidence suggests that different kinds of inserted questions 
nay be differentially effective in promoting learning from text. In this 
experiment one of four groups had Inserted knowledge-level questions and 
a second group comprehension questions. It was argued here that; 
1. In previous adjunct-question research, treatment groups have been 
forced to study in a manner that would not obtain outside of experimental 
conditions; 2. valid control groups have not been employed. Therefore, 
adjunct groups were permitted freedom to study according to preference, 
and two controls were run: Idiosyncratic study; and Passive reading. 
8s In the Idiosyncratic condition consistently outperformed the others 
(p<.001) but overall differences of test means were not significant* 



A OOMPARISOM OP IDIOSYNCRATIC STUDY, PASSIVE READING AND INSERTED 
QUESTION TREAIKENTS IN LEARNING PROM TEXT 



It is nov generally believi.i Ly researchers Interested in developing 
an understanding of hew students learn from text that inserted po4t questions 
asking about specific information enhance the learning of that information 
(Rothlcopf, 1966) and of information categorically related to the questions 
(Rothkopf & Bisbicos^ 1967). Given that S hasn't the capacity or interest 
to learn or memorize everything that may be asked about the text he has 
studied^ it is not surprising that question related learning is raised 
where the passage Just read is sufficiently short and clear enough to per- 
sist in Immediate memory while the question is being answered, since the 
3 hoa an opportunity for selective rehearsal of the questioned information 
(HcGaw & Grotelueschen, 1972). The rather surprising finding of many in- 
serted question studies has been that acquisition of information not directly 
related Co the inserted post question answers is also raised. 

To enable as clear an analysis of the learning process as possiblei 
Rothkopf (1966) and subsequent investigators had directed the inserted post- 
question groups to study their text under the constraint that, once the S 
sought to answer a post question, preceding text upon which the question was 
based could not be reviewed throughout the remainder of the experiment • 
Since it is unrealistic to suppose that students preparing for examinations 
in their regular school work would accept such a restriction on their 
study activity, the results of these well-controlled experiments cannot be 
readily generalized to natural settings* In a recent experiment which per- 
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nlttdd rcvievlngy inserted question groups actually demonstrated acquisition 
inferior to the controls on a test which covered information having only an 
Incidental relationship to the inserted questions (Killer, 1972). In the 
study reported here, Ss having inserted post question treatments were per* 
ttitted to review their text as they wished. 

A second problem relating to external validity concerns the standard 
control groups which have traditionally been directed to read passively. 
Questionnaire data ccnccrning how college students study in non-experinental 
settings has shown that passive reading is quite rare (Hiller, 1972) • 
According to anonymously supplied information by 428 £6, A77L usually write 
notes %ihile reading, while another 41% claim to write notes sometimes— only 
12X reported that they never write notes. Data concerning underlining 
presented the same pattern of overt study activity. Perhap'^ ^lurprisingly^ 
SOX reported that they outline usually ar sometimes, thv it would 
appear that passive reading does not roprcsont a valid pr^ odure for esti- 
oating the effect of experimental troatmcntn which arc intended for practical 
application* Therefore, a control group, dc dgnatcd Idiosyncratia study » 
vaa amployed l.n addition to the standard passive reading control. Further- 
morei the inserted question groups vcrc also permitted to exercise thei;. 
active study skills. 

A third element of the research conducted for this re^^ort related to 
the nature of the questions asked of the S^. Increasingly > educators and 
researchers alike have been concerhed with promoting levels of cognitive 
learning hi^er than knowledge or rotely acquirable information. Toward 
this end I inserted post questions classified by the Bloom Taxonomy as in 
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the Coffiprohenfilon domain vcre compared for ef fectlvoncas vlth Kncirladge 
questions. Previous research on this topic has not produced consistent 
results (Dcnzel* 1971; Hunklns, 1968 & 69; McKenzie. 1972; Quiring, 1972) • 

Subjects 

Ihe Ss (90 in all) were c^udents enrolled in Educational Psychology, 
and they were fulfillins a course cxperiotentatlonj requlrctoent. 

Lesson and Testa 

Ihe lesson was about a particular theory of economic growth in nations^ 
and was taken verbatim from the Kropp & Stoker (I9f6) collection. Ihe 
text coutained 1500 words, was rated by the Sb as being of average reada- 
bility, and was presented in a booklet with approximately 200 words on each 
of eight pages* Die teat, also adapted from Kropp & Stoker, contained 
twenty knowledge and twenty comprehension multiple-choice questions which, 
by judgment, could not be answered by using any of the Information covered 
by the inserted question treatments. Since the fact of question related 
learning is undisputed, the test did not include the inserted questions. 

Treatments i 

As described above » two control groups were run: 1« Passive reading, 
in which the Ss were Instructed to study as they wished except that they 

were not to mark the lesson pages not to write notes on any other paper; 

J 

Zm Idiosyncratic study, in which the ^s were instructed to study in any 
naanfir they vlBhed Including the opportunity to write on the lesson, or 
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Uftderllnttf etc. One uf the two treatment groups h^^^ eight Inierted 
knowledge pogt queotions, one question after e^ch page, and the other 
group hed comprehension questions* The inserted questions vere randomly 
dravn from the Item pool used to form the criterial tests, the inserted 
question groups vere informed by their instructions that there would be 
a question after each psge and that they should not go on to any question 
uetil they felt coafident about the page Just road. Ihe directions da* 
scribed the questions as study lids or check points, lha Sb vere required 
to respond to the questions on chair data sheets without looking back at 
the tert* However ^ the directions made it clear th8^ they could review 
the lesson after answering tho question; while looking ahead , or eraalng 
answers to the inserted questions were barred and described as defeating 
the study technique. In addition^ the Ss were given the same explicit 
permlasion to employ active study techniques as vas given the Idiosyncratic 
control. 

Questionnaire Data 

Immediately after finishing the lesson, but prior to the test» all £s 
vere given a ()uestlonnalre vhlch asked them to rate the utility of their 
atudy technique, the readability level of the lesson, and their Interest in 
the lesson's topic. The rating scale was scored from 1-S» with 5 toast 
favorable* 

Procedure a 

The ^8 were rondoEily assigned treatments as they entered a large 
lecture hall. They were seated in alternate spaces, given all materials in 
envelopes, and afforded up to 35 minutes study time. Ihe general purpose 
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of the Qxperinant, to develop Infonndtlon concerning the relative effective 
reee of different itudy oethodii wae explained end their cooperation vaa 
solicited* All Ss vere Infonaed before studying that the test to follow 
vould cover "your retention of facts and your understanding of the Ideas 
presented/' in oussnaryt the Ss studied the lesion at a self-controlled pace, 
filled out the questionnaire p and then insncdiatcly took a coabined knov* 
ledge and cotaprehension test. Observation by the ts Indicated that lack of 
tiae did not directly affect studying nor testing. 

RESULTS 

Learning for all £s was substantial in that the overall combined test 
average was 61% correct for the 40 items* Inspection of test means, see 
Table 1, shows that the Idiosyncratic group performed slightly better than 
the others on both the Knowledge and Coraprehoneion questions* However, each 
ANOVA for the subtests and the combined test showed that differences among 
treatment means were not significant at p < .lO* 



Insert Table 1 about here 



A second, finer grain analysis focused on the pattern of results dem- 
onstrated by the forty, criterion test Items * From acquisition results In 
Hlller, 1972, it could be hypothesized that test performances would be rankcO : 

Ha: Idiosyncratic > Passive reading > Knowledge > Comprehension, 
under an assumption that the inserted knowledge questions were relatively 
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Msy tad the cofsprehenalon que>tlon0 fQlatlvcly hatd* (Thlt Aitu»ption 
VM verified by the data since the Inserted knowledge quett^ont hed 
e difficulty level of 81%, vtille the coaprehenslon questions had a 
difficulty level of 597.0 The nianbor of Items for which each tr^^atmcnt 
Mrned the hlj^est score ( the proportion of Ss correct, cot ting ties) was: 

Idio,* 23; Pass R. • 6; Know • 9; Cotnp 0. 6. 
Meona for the Itea ranks were (highest rank f:carcd as 4 and lowest as 1): 

Idio • 3.24; Pass R. ■ 2.28; Know Q« • 2.48; and Coop Q. « 2.06. 
An L test corresponding to Ha yielded L • 1071 .5 for the 40 test ltexns» so 
that Ho ^as rejected at p < .OOl. Hie rejection of the null hypothesis 
is due primarily to the correct prediction of Idiosyncratic as hi^est and 
Comprehension as- lowest, since the Knowledge group was sli^tly hi^er than 
Passive reading. A Chi Square test of the difference between Idiosyncx atic 
and Knowledge item pcrfortnancc was also significant, tX? • SA, p < .Ol* 

The questionnairo data showed that S interest in the lesson was pre« 
dictive of test performance, and liking for the study technique was pre- 
dictive of comprehension test performance to a minor extent (see Table 2)« 

Insert Table 2 about here 

The lesson received ratings describing it as average for both interest and 
readability. Ratings for the study methods did not significantly differ. 

DISCUSSION 

In contrast to the currently held generalization concerning the value 
o£ inserted post questions for incidental learning, the present results 
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•ugSMfc th«C tncldcntaJ learning tfi «Hgh#t2y : ^f:rc^, if It l§ a£fpct<^d 
At 4ll« TUb difference Hntvucn thC5«: ror^ « ^^nii t < rto cf prcvlou* 
•tudlet My be flttrlb ttr.d to changed In the r7r-.orin^ntfl* trcatwent dinic* 
tlotii. yWllii rcvlcru* pcrftlttcd, but note writing, tjrdrr lining, etc» not 
al.9v«d| Hlllcr (1972) haJ found that relatively ^.ird ^^wcatloni (difficulty 
levtl of 53Z) produced a signiiiraat depression of Uarning for a lesson 
of cvorage roadablllty* yith the arbi:r«ry rp-iirlctton on actlvo atudy 
skills roooved, thlo ofpcrlnwTU fouTui the ucprraalon to bo of a sll^t^ 
oonalgnlf leant oa^riltude; although It la r.ot ccmpictoly certain that ra* 
ductlon of the depression is entirely attributable to the eased restrict 
tloni since the lesson employed hero had a significantly higher Interest 
rating than the lesson used by Hlller, and intercfst correlated with leam« 
ing* 

Ihe finding that Conprchenslon and Knowledge treatments were not 
differentially effective Is ccnslstent with previous research by Hunklns 
(19C9)» Quiring (1972) and Dcnzcl (1971). Oenzel (1971) compared the 
effects of Application and Analysis inserted post questions (review not 
permitted) along with Knowlcdi^c an ' Comprehension and did not find any 
differences among thenc treatments, nor between those treatments end a 
Passive reading control, for Incidental learning. It would seem that a 
text processing analysis is needed to explain hypothetical effects specific 
to question types* In the present study^ inspection of the inserted 
questions revealed that both the Knowledge and Comprehension types could 
be answered primarily by Information contained in only one, or a very few» 
lesson sentences* Ihus, answering the questions did not force careful i 
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octaadod procottlng ol text Incldontat to the questions. ?n fact» ooa 
my parcolvo ionothln^ of a JiiesiM hero, since lenmlng %iDuld tiot h«vo 
bMn clMtlfied Oil Incidental had the insertc<i qjostlont rcqulrfid tuch 
MtMdod procosslng. 

Conormlng practical Inplicationa that ray be drown froD this 
•tudy» it vould oocrn at firot glance that tSir r.ct effect o£ Insortod 
qutstlons ought to be positive, bccaune inLiocniaJ depression appears 
alight while direct instructive effects tnay ba substantial. Hoimvart 
there yet reaains an Important practical question unonoverod by this and 
sifldlorly designed cxp«»ritQcnt8*«how will s^udcnLs actually use inserted 
questions when studying for real eKomlnationir? If the study questions 
did not form a significant part of their cxAniinationa , ve may predict 
that attention to then wovld extinguish* On tho other hand» if the in* 
serted questions did form a major part of Uicir to!its» ve may predict 
that etudents would look ahoad to find the questions while studying » and 
thereby risk the loss of incidental learning found by Rothkopf (1966) 
and others for pre-quostlon treatments. If this analysis is correct, 
then an effective pedagogical use of Insorted questions would require 
that they comprehensively represent both Instructional objectives and 
examination lest items* 
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